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An  Inflate  Markov  process  with  a  finite  numoer  of  states 
Is  studied  In  which  the  transition  probabilities  for  each  state 
range  independently  over  sets  which  are  either  finite  or  are 
convex  polyhedra.  A  finite  computational  procedure  is  given 
for  choosing  those  transition  probabilities  which  minimize  ap¬ 
propriate  functions  of  the  resulting  equilibrium  probabilities. 


P-lCs2 

ill 


CONTENTS 

SUMMARY  .  ii 

Section 

1.  INTRODUCTION  .  1 

2.  THE  PROBLEM  .  3 

3.  PORMULATION  AS  A  LINEAR  PROGRAMMING  PROBLEM  .  b 

ii.  COMPUTATIONAL  ALGORITHM  --  THE  MASTER  PROBLEM  ...  9 

The  Iterative  Step  .  10 

Phase  One  .  11 

Phase  T v/o  .  1? 

•).  THE  SUBPROBLEM  ANT)  PROOF  OF  TERMINATION  .  13 

REFERENCES  .  16 


P-1842 

1 


1 .  INTRODUCTION 

Recent  studies ,  cited  below,  have  indicated  considerable 
Interest  in  optimization  problems  formulable  as  problems  of 
choosing  a  set  of  distributions,  constituting  the  transition 
probabilities  of  a  finite  Markov  process,  in  such  a  way  as  to 
minimize  certain  "costs"  associated  with  the  process. 

The  following  inventory  problem  is  a  typical  example  of 
this  class:  Let  the  n  attainable  levels  cf  the  Inventory  of 
an  item  constitute  the  n  states  of  a  Markov  process.  Transi¬ 
tion  from  one  state  to  another  will  occur  at  the  end  of  each 
of  an  infinite  sequence  of  time  periods.  Owing  to  the  uncertain 
nature  of  supply  and  demand  for  the  item,  whose  distributions 
only  are  assumed  known,  the  effect  of  a  given  inventory  policy 
must  be  described  as  a  distribution.  For  any  Inventory  policy 
the  probability  p^j  of  transition  from  state  1  to  state  J 
in  one  time  period  is  known,  as  well  as  the  cost  c^j  ,  depen¬ 
dent  on  the  policy,  which  will  be  incurred  if  that  transition 
is  made.  T,nder  any  policy  the  time-series  of  inventory  levels 
constitutes  a  Markov  process  described  by  £he  given  probabili¬ 
ties.  When  an  initial  state  for  the  first  period  has  been 
given,  the  long-run  probabilities  p^  are  then  determined. 
Intuitively,  p^  is  the  probability  that,  at  a  typical  time 
period  in  the  indefinite  future,  the  transition  from  state  1 
to  state  J  will  take  place.  The  "long-range  expected  cost" 
of  using  the  particular  policy  is  then  defined  as  ^  c^  p^j  • 
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The  computational  problem  is  thei.  that  of  minimizing  this  ex¬ 
pected  cost  over  all  available  Inventory  policies. 

The  formulation  of  such  a  problem  as  a  linear  programming 
problem  has  been  done  by  Manne  [5],  d'Epeijoux  [3],  and  Oliver 
[6]  for  problems  in  which  it  is  possible  to  choose  the  transi¬ 
tion  probabilities  ,  for  each  1  separately,  as  one  of 

a  given  finite  set  of  distributions.  The  same  assumption  on 
the  available  distributions  Is  made  by  Howard  [4]  In  his 
"dynamic  programming"  treatment  of  this  class  of  problem.  The 
Observation,  however,  that  the  problem  formulated  as  a  linear 
program  can  be  efficiently  attacked  by  means  of  a  specialization 
of  the  decomposition  algorithm  for  linear  programming  [2] ,  makes 
It  possible  to  broaden  considerably  the  class  of  problems  that 
can  be  handled,  by  permitting  other  descriptions  of  the  sets 
of  available  alternatives.  In  the  sequel,  two  extreme  cases 
are  considered:  ♦’.he  case  described  above,  on  the  one  hand;  and, 
on  the  other,  the  case  in  which  the  distributions  which  may  be 
used  are  restricted  only  by  being  required  to  satisfy  certain 
linear  inequalities.  Since  these  two  extreme  cases  are  handled 
by  essentially  the  same  method,  intermediate  cases,  which  are 
of  practical  interest,  can  readily  be  treated  by  the  same  tech¬ 
nique  . 
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2.  THE  PROBLEM 


i 


* 


I 


Throughout  this  paper  n  is  a  fixed  integer.  By  distri¬ 
bution  is  meant  an  n-vector  x  ■  (x1,..,xn)  such  that  >  0 
(all  i)  and  £x^  •  1  .*  A  Markov  process  is  defined  by  n 
distributions  •  (Pn**»#Pin)  for  1  #  wnere  p^j 

is  the  probability  of  transition  from  state  i  of  the  process 
to  state  J  . 

In  the  problem  studied  here,  a  particular  Markov  process 

is  defined  by  a  choice  of  distributions  from  certain  sets.  In 

this  section  and  the  next,  these  sets  will  be  assumed  finite: 

For  each  1  -  l,..,n  ,  let  3.  be  a  finite  set  of  distri¬ 
butions  .  1 

In  addition,  a  "cost"  e^JP)  is  associated  with  each  distribu¬ 
tion  P  in  : 

For  each  i  ■  l,..,n  ,  let  c.  be  a  real -valued  function 
on  .  1 

For  P  In  si  *  ^(P)  Is  thought  of  as  a  fee  to  be  paid  for 
the  use  of  the  distribution  P  when  passing  through  state  1  . 

The  particular  manner  in  which  5^  and  c^  are  described 
is  not  of  great  Importance  in  the  discussion  which  follows,  but 
it  does  play  an  Important  role  in  the  computational  algorithm 
of  Sections  4  and  p.  The  more  extensive  discussion  of  Section 
5  can  be  anticipated  by  the  observation  that  the  algorithm  is 
aimed  at  handling  either  of  the  following  two  extremes:  (a) 


*The  symbol  "  Y.  " 


n 

&  • 


is  used  throughout  as  an  abbreviation  of 


ft 


ft 
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Is  given  as  an  arbitrary  finite  set,  and  as  an  arbi¬ 
trary  function  on  ;  (b)  A  finite  set  of  linear  Inequali¬ 

ties  In  n+1  variables  is  given,  defining  an  n+1-dlmensional 
polyhedron  in  such  a  way  tnat  the  first  n  coordinates  of  any 
point  of  this  polyhedron  form  a  distribution.  The  first  n 
coordinates  of  any  extreme  point  of  this  polyhedron  constitute 
a  member  P  of  ,  with  c^(P)  defined  as  the  minimal 
n+l8t  coordinate  of  all  extreme  points  whose  first  n  coor¬ 
dinates  constitute  P  .* 

If  now  particular  P^  in  are  chosen  for  each  1  , 

then  a  Markov  process  is  defined.  Let  x  be  an  equilibrium 
distribution  for  this  process  —  that  13,  a  distribution  satis¬ 
fying  relation  (2.2)  below.  The  "expected  cost"  of  the  process 
per  stage,  when  the  equilibrium  x  obtains,  is  then 

(2.1)  ^-c^Pj)  x±  . 

The  Markov  programming  problem  is  that  of  choosing  the  P^  in 
such  a  way  that  thi3  expected  cost  13  minimized. 

Formally,  the  problem  is: 

Determine  P^  In  (1  -  l,..,n)  such  that  (2.1)  is 

minimized  for  all  x  such  that 

- * -  ,  V 

It  will  be  seen  from  the  discussion  of  case  (b)  in  Sec¬ 
tion  5  that  the  restriction  of  S.  to  extreme  points  of  the 
polyhedron  is  unnecessary,  since  even  if  all  points  were  ad¬ 
mitted,  only  extreme  points  would  appear  in  the  solution  of 
the  problem.  Uiis  restriction  is  made  because  of  the  conven¬ 
ience  of  assuming  to  be  finite. 
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(2.2)  ^  0  ,  IV1,  and  Y  x^  «  x  . 

It  will  be  convenient  for  the  sequel  to  restate  this  prob¬ 
lem  In  such  a  way  that  the  equations  (2.2)  have  constant  right- 
hand  3ldes . 

For  each  1  ,  let  be  the  set  of  all  n-vectors 

(2.3)  -  (P11»..,P11-l#..,Pin) 

for  which  (p^j » . . . .#Pln)  «  P^  Is  In  ,  and  define  c^  on 
Ti  by  ®i  (Qi)  ■  ci  (pi)  *  using  the  correspondence  given.  The 
problem  may  then  be  stated: 

Determine  in  (1-1,.. #n)  such  that 

(2.4)  Zc1  (Q^)  x± 

Is  minimized  for  all  x  such  that 

(2.5)  xA  >  0  ,  Hxi  -  1  ,  and  Yx^  -  0  . 

It  is  clear  that  any  solution  x;P^,..,Pn  of  the  problem  stated 
by  (2.1)  and  (2.2)  gives  a  solution  xjQ^,..,^  of  the  problem 
(2.4,  2.5),  and  vice  versa.  4 
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3.  FORMULATION  AS  A  LINEAR  PROGRAMMING  PR03LEM 


The  problem  (2.4,  2.5)  will  be  solved  with  the  devices 
developed  for  the  "decomposition"  of  linear  programming  prob¬ 
lems  of  special  structure  [2],  specialized  to  the  case  at  hand. 
The  central  idea  of  this  approach  is  the  formulation  of  the 
problem  to  be  solved  as  a  linear  programming  problem  whote  data 
consist  primarily  of  the  coordinates  of  points  of  the  set  . 

This  will  be  done  In  this  section.  Por  each  1  ,  let  the 
points  of  T^  be  Qk  for  kal,..,]^  .  Is  an  abbreviation, 
let  clk  “  ^1  (^i)  for  •  Consider  the  linear  program¬ 

ming  problem  | 

Minimize 

^^kll  °lk  yik 

under  the  constraints 


(3.2) 


'ik 


>0  ,  II  1  yik  -  1  ,  II.1 


k-1 


k-1 


ylk  Ql  "  0  * 


TCieorem  1  below  will  show  that  this  problem  Is  equivalent 
to  the  problem  of  the  previous  section.  In  general,  replacing 
a  discrete  problem  by  a  continuous  problem  in  this  manner  can 
lead  to  a  solution  that  is  not  discrete,  but  the  Lemma  below 
shows  that  for  the  problem  studied  here  the  solution  of  the 
continuous  problem  is  itself  sufficiently  'discrete"  to  ensure 
equivalence:  Por  each  1  ,  only  a  single  Is  actually  in¬ 

volved  In  the  solution  of  the  problem  (3.1»  3.2). 
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LEMMA:  There  is  a  solution  of  the  problem  (3.1,  3.2)  with 
the  property  that  for  each  1  there  Is  at  most  one  k  for 
which  yiJc  >  0  • 

Proof:  The  coefficients  and  right-hand  side  of  the  linear 
programming  problem  (3*1*  3.2)  are  displayed  in  the  table  below, 

lr 

headed  by  their  variables  y1Jc  ,  where  p^  denotes  the  appro- 

1 r 

prlate  component  of  the  distribution  P  corresponding  to  . 

Table  1 


yll  yl2  y2l  y22 


It  is  a  basic  property  of  linear  programming  problems  [l] 
that,  when  a  solution  exists,  there  is  a  solution  having  exactly 
—  say  r  --  positive  components  for  which  the  suLmatrlx  con¬ 
sisting  of  those  columns  of  the  coefficient  matrix  associated 
with  the  positive  components  has  rank  r  .  Por  this  problem, 
denote  by  B  the  (n  +  1)  by  r  submatrix  of  (3.3)  given  by 
that  property;  the  associated  solution  will  be  the  one  whose 
existence  the  lemma  asserts.  (As  a  matter  of  fact,  the  simplex 
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method  solution  of  this  linear  programming  problem  will  yield 
a  solution  of  Just  this  type.) 

Let  s  be  the  number  of  rows  of  B  In  which  may  be  found 

l r 

an  entry  of  the  form  p^-1  •  Excluding  the  first  row,  the 
other  n  -  s  rows  have  only  non -negative  entries;  since  their 
right-hand  sides  are  zero,  and  their  variables  y^^  positive, 
these  rows  must  In  fact  vanish,  and  B  has  Just  s  +  1  non- 
vanlshlng  rows.  The  non -vanishing  rows  are,  however,  linearly 
dependent  (the  sum  of  all  rows  but  the  first  Is  zero),  whence 
the  rank  of  B  Is  at  most  s  ,  that  Is,  s  ^  r  .  Since  B 
has  Just  r  columns.  It  follows  that  at  most  one  entry  of  the 
form  Pij-1  can  be  found  on  any  row  of  B  ,  so  that  at  most 
one  column  of  (3»3)  can  be  found  In  B  for  J  given,  which 
proves  the  lemma. 

Theorem;  The  programming  problems  (2.4,  2.5)  and  (3.1, 
3.2)  are  equivalent,  their  solutions  being  related  in  this  way: 

Given  yiJ(  solving  (3.1»  3»2)  and  satisfying  the  conclu¬ 
sion  of  the  lemma,  let  for  each  1 


i  -  ytk 

i-«4 


x^  «  0 


arbitrary  in  J 


where  y^  >  0  for  some  k  , 

If  y,,.  -  0  for  all  k  . 


ik 


On  the  other  hand,  given  x^  ,  solving  (2.4,  2.5) »  let 


'ik 


for  k  such  that  , 

0  otherwise  • 


Proof: 


Obvious 
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4.  COMPUTATIONAL  ALOORITHM  —  THE  MASTER  PROBLEM 

The  linear  programming  problem  formulated  In  the  last  sec* 
tlon  has  only  n+1  equations,  but  It  has  £ variables,  a 
number  which  may  be  very  large,  and  not  even  known  for  problems 
whose  data  are  given  Implicitly.  The  revised  simplex  method 
[l]  is  particularly  advantageous  for  problems  having  many  more 
variables  than  constraints.  The  decomposition  algorithm  uses 
this  efficiency  of  the  revised  simplex  method  by  clearly  sepa¬ 
rating  the  considerations  Involving  the  constraints  alone  from 
those  connected  with  the  handling  of  the  variables.  That  part 
of  the  problem  involving  the  constraints  Is  called  the  "master 
problem,"  and  its  handling  Is  set  forth  In  this  section.  That 
part  of  the  problem  Involving  the  variables,  called  the  "sub¬ 
problem,"  Is  dealt  with  In  the  next  section.  It  will  be  seen 
that  the  work  of  treating  the  master  problem  consists  of  little 
more  than  the  application  of  the  revised  simplex  method  to  the 
Markov  programming  problem  as  formulated  In  Section  3*  The 
general  iterative  step  is  given  below,  fqllowed  by  the  proce¬ 
dures  for  initiating  the  Iterative  process  and  for  passing  from 
the  determination  of  an  Initial  feasible  point  (Phase  One)  to 
the  determination  of  the  solution  of  the  problem  (Phase  Two) • 
(The  phenomenon  of  degeneracy  plays  the  same  role  In  this  algo¬ 
rithm  as  In  any  linear  programming  problem,  and  It  will  be 
supposed  that  standard  methods  [l]  may  be  relied  upon  when 
necessary. ) 
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THE  ITERATIVE  STEP 

At  any  step  in  the  course  of  the  solution  of  the  problem 
(3#1#  3.2)  by  the  revised  simplex  method,  there  will  be  at  hand 
some  n+1  column  vectors  (of  length  n+1)  con¬ 

stituting  a  "feasible  basis";  that  Is,  they  are  linearly  Inde¬ 
pendent,  and  the  right-hand  side  of  the  equations  (3.3)  may  be 
expressed  as  a  non-negative  linear  combination  of  them.  (The 
weights  in  this  linear  combination,  which  of  course  constitute 
a  solution  of  equations  similar  to  (3.3)  deriving  their  coef¬ 
ficients  from  the  Q*  ,  are  called  collectively  a  "basic  feasi¬ 
ble  point.") 

Let  the  "cost"  cT*  be  associated  with  the  column  , 
for  i*l,..,n+l  .  The  "prices,"  assumed  known,  associated  with 
this  basis  are  defined  to  be  the  components  of  the  n+1 -vector 
v  •  (tj,  .  satisfying  the  relationships  =  F1 

(i*lj . . ,n+l )  . 

One  iteration  of  the  simplex  method  consists  of  the  fol¬ 
lowing  steps: 

(1)  Find  a  column  0  of  the  matrix  (3*3)  which,  with  its 
associated  cost  c  ,  satisfies  the  relation 

(4.1)  c  —  irQ  <  0 

(commonly  the  column  for  which  c  -  irQ  i3  minirral  is  chosen) . 
This  is  the  only  point  in  the  revised  simplex  method  at  which 
all  the  columns  —  or,  what  is  the  same  thing,  all  the  varia¬ 
bles  —  in  the  problem  come  into  play.  This  step  forms  the 
"subproblem,"  whose  study  is  deferred  to  Section  5. 
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(II)  If  no  column  satisfying  (4.1)  can  be  found,  then  the 
current  basis  1b  "optimal,”  and  the  solutions  of  the  equations 
(3.3)  solve  the  linear  programming  problem. 

(III)  Otherwise,  add  the  column  found  to  the  current 
basis,  and  remove  one  column  In  such  a  way  (given  by  the  rules 
of  the  simplex  method)  that  the  remainder  still  forms  a  feasible 
basis;  calculate  the  new  prices,  and  begin  again. 


PHASE  ONE 

The  algorithm  can  be  started  with  precisely  the  same  de¬ 
vice,  called  Phase  One,  used  for  the  general  linear  programming 
problem.  TTCiis  device  consists  In  augmenting  the  problem  with 
m+1  "artificial"  variables  In  terras  of  which  an  Initial  feasible 


! 

i 


basis,  and  the  prices  associated  with  the  corresponding  Initial 
feasible  basis,  are  readily  given.  The  algorithm  can  then  be 
applied  to  the  problem  of  removing  the  artificial  variables. 
After  this  has  been  done,  the  required  starting  conditions  for 
the  ordinary  application  of  the  algorithm  are  automatically  met. 

For  l>l,..,n+l  s  let  y^  be  a  non-negative  variable; 
let  1^  be  the  iVI  column  of  the  n+1 -order  identity  matrix; 
and  let  c^  *  1  be  the  cost  associated  with  the  variable  y^  . 
For  this  phase,  replace  all  the  costs  c^  of  the  original 
problem  with  zeroes. 


Designating  Ii»*,»In^l  as  the  feasible  basis, 

n-fl 

employ  the  Iterative  step  above  until  the  linear  form  T  y 


has  been  minimized.  (Note  that  the  Initial  feasible  point  is 
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(y1#..,yn4l)  •  (1,0,.., 0)  and  that  the  initial  prices  are 

ir  «  (1,1, ..,1)  •) 

The  above  process  will  reduce  the  form  L  y.  ,  and 

i=l  1 

hence  each  y^  separately,  to  zero.  (If  it  did  not,  then  the 
equations  (3.2)  would  have  no  solution,  which  is  Impossible.) 
Owing  to  the  linear  dependence  of  the  equations  (3.2),  some  of 
the  starting  columns  1^  will  remain  in  the  feasible  basis  at 
the  end  of  Phase  One;  this  can  be  shown  to  cause  no  difficulty 
in  the  ensuing  process  [1]. 

PHASE  TWO 

When  Phase  One  is  finished,  restore  the  deleted  cost3 

Jr 

clk  co^uinn3  ,  using  these  costs  from  now  on  in  the 

determination  of  the  prices  ir  .  Repeat  the  iterative  step 
until  it  terminates  in  its  part  (ii). 

V 

At  termination,  associated  with  each  in  the  final 

feasible  basis  is  a  component  of  the  "feasible  point,"  the 

V 

weight  given  in  expressing  the  right-hard  3lde  of  the 

equations  as  a  linear  combination  of  the  columns  of  the  basis. 
For  i  -  l,..,n  ,  according  to  the  Theorem  of  Section  3,  there 
can  be  no  more  than  one  in  T^  in  the  basis  having  posi¬ 

tive  weight;  thus  let 

weight  for  ,  if  positive, 

xi  -  | 

L0  ,  otherwise. 

The  resulting  (x^,..,xn)  is  the  solution  of  the  problem  (2.2). 

/ 
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5.  THE  SUBPROBLEM  AND  PROOF  OF  TERMINATION 

The  detailed  discussion  of  part  (i)  of  the  iterative  step 
of  Section  4,  the  "pricing  out"  operation  in  the  ordinary  re¬ 
vised  simplex  method,  was  deferred  to  this  section.  Given  the 
quantities  w  ,  it  constitutes  the  problem  of  determining  some 
column  Q  and  its  associated  cost  c  for  which 

(5.1)  c  -  irQ  <  0  , 

where  Q  may  come  from  any  of  the  sets  T^  •  How  this  is  done 
depends  on  the  nature  of  the  description  o the  original  sets 
S^  from  which  the  T^  were  obtained.  Evidently  the  problem 
of  satisfying  (5.1)  from  among  the  union  of  all  the  T^  may 
be  "decomposed"  into  n  problems,  the  1th  one  of  which,  for 
i  «  l,..,n  ,  is  that  of  satisfying  (5.1)  for  Q  in  .  If 
any  of  these  "subproblems"  can  be  solved,  then  the  stated  prob¬ 
lem  has  been  solved. 

For  each  i  ■  l,..,n  ,  one  of  the  two  "extreme"  cases 
mentioned  in  Section  2  may  obtain.  (Some  "intermediate"  case 
might  also  be  considered,  but  this  will  not  be  done  here.) 

(a)  is  given  directly  as  a  finite  set  of  distribu¬ 
tions,  a  cost  c^(P)  being  associated  with  each  member  P  of 

Si  * 

(b)  There  is  given  a  finite  set  of  linear  relations 
£j(z)  ^  0  »  J  *  l,..,m 


(5.2) 


» 
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In  the  n+l  variables  (zi*««»zn+i)  •  2  »  such  that  2 
satisfies  (5.2),  then  (z^,..,zn)  is  a  distribution;  S<  is 
defined  to  be  the  set  of  all  P  »  (z1#..,zn)  such  that  for 
some  zn+i  »  z  ■  (P;zn^)  *3  40  extrerTie  point  of  the  set  of 
all  z  satisfying  (5.2);  and  for  P  in  ,  ci(P)  is  de¬ 
fined  to  be  the  smallest  value  of  zn+^  for  which  (P;zn^) 
is  such  an  extreme  point.  (The  index  i  has  been  omitted  above 
of  course,  the  relations  (5.2)  may  be  different  for  each  i  ,  or 
even  absent.) 

In  the  case  (a),  there  is  not  much  to  be  said.  Phrased, 
via  the  definition  (2.3),  in  terns  of  ,  relation  (5.1)  urges 
the  selection  of  P  in  3^  for  which 

(5.3)  c1(p)  -  rP  +  <  0  . 

Such  a  P  will  yield  through  (2.3)  a  column  Q  satisfying 

(5.1). 

Case  (b)  is  more  interesting,  in  view  of  the  fact  that  the 
extreme  points  of  the  polyhedron  defined  by  (5.2)  have  not  been 
assumed  to  be  available  in  advance.  Replacing  P  and  c^(P) 
in  (5.3)  by  their  definitions  in  this  case,  it  i3  desired  to 
choose  z  ■  (zi# • •#zn+i)  under  the  constraints  (5.2)  in  such 
a  way  that 

(5-1*)  zn+l  *  L-].!  TJ  zj  +  *1  <  0  • 

This  is  nearly  a  linear  programming  problem;  if  the  customary 
procedure  for  the  simplex  method,  that  of  making  the  left-hand 
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side  of  (5.3)  as  small  as  possible.  Is  followed,  then  the  task 

Is  precisely  a  linear  programming  problem:  under  the  constraints 

(5.2),  minimize  the  left-hand  side  of  (5.4).  Having  performed 

this  minimization.  If  the  result  Is  not  negative,  it  13  of  no 

Interest;  but  If  It  Is  negative,  then  the  column  Q  «  (z^,.., 

z«-l,..,z_)  and  Its  cost  c  •  z  ,  constructed  from  the  solu- 
l  n  n+l 

tlon  of  the  problem  satisfy  equation  (5.1).  Furthermore,  Q 
will  be  an  extreme  point  of  the  polyhedron. 

The  complete  solution  of  the  subproblem  then  goes  as  fol¬ 
lows:  For  each  l«l,..,n  ,  attempt  to  satisfy  (5.1)  from  -- 
or,  equivalently,  attempt  to  satisfy  (5.3),  or  (5.4),  from  3^  . 
If  this  can  be  done  for  any  1  ,  part  (1)  of  the  Iterative  step 
of  Section  4  can  be  accomplished.  (It  Is  Indifferent  to  the 
fact  of  the  convergence  of  procedure,  although  probably  not  to 
Its  rate,  whether  or  not  the  1  for  which  (5.1)  Is  minimized 
Is  chosen.)  If,  on  the  other  hand,  (5*1)  cannot  be  accomplished 
for  any  1  ,  then  part  (11)  of  the  Iterative  step  obtains,  and 
the  procedure  has  terminated. 

It  remains  only  to  show  that  the  algorithm  Is  finite.  This 
follows  Immediately,  however,  from  the  flnlteness  of  the  simplex 
algorithm  for  linear  programming  [l] ;  because,  as  described  In 
Section  4,  this  algorithm  Is  precisely  the  simplex  method  ap¬ 
plied  to  the  linear  programming  problem  (3.1,  3.2).  Whether 
the  sets  T^  of  columns  are  described  in  the  manner  (a)  or  (b) 
above,  they  are  finite  in  number,  and  the  proof  is  complete. 
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